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tte* matted of pa*rod oompariaoa la a wall 
known tocJmlqno of p spate logioal and p apatephy ataal 
aaallng of atiumll* fte rang* of appllaabilitp of 
tki* matted i* oxtondad to ranking and aaallng of 
affoatlvt valoao# and of ooithotl* valnaaj visual* 
aaditory and taata atlattiif atatoamnta rapraaentim* 
varying abadaa of oplnloma on Qtjaatlona of aooial 
Importanao nook &a prohibition* war* volition oto# 
It might roplaoo tha loan aoowato and loaa valid 
procaduras of rating asoloa* wlwro tfeo nova owaot 
and aaooroto proaodmrot of aonling aro noodod* 


mfttood of palrad oompariaona la a diraat wotted for 
obtaining oapirloal oatlwatoa of tte proportion of 
gtmsa top otlaa&lna i la jhadgod groator or feottor man 
otnar at lamina fa do thia wotted wight vary wall 
provldo a orltorioa of validity agaiwat dklok to 

mm any of too loot o^mato or , 

arttwAt *f KlwU> ptwon*, t&taM* «*•*’**«* J 
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Sheerer* ttorn is on® objwtitm oftw rai^eo. 
againat the method of paired oomparieoa®. Whea tto» nuato#r 
of stimuli 1* IS or more than 1S» the number of pair® 
wlil be 103 or mere* the method of paired aomparieon® 
becomes ouebereome and other extraneous faotore* ©uah a® 
fatigue* boredom ete* enter Into the proaeee* These 
extraneous fa© tor© rest riot the applicability of the 
method of paired eompariaone* She paired comparison# 
le one of the beet method® of soaling* but thi® method 
i© generally reoewnended only when the number of 
stimuli 1® IS or less* 

Several abort out procedure* a® u®e of 
partial pair® or triad® are suggested for feh* «*•• 
whan the at imull are large in mafeefi ®o that the 
labour involved in making copperleion® i* redwood* 

In %m thi® study* the wain ebjeetive i® to oompere 
th» method© using (a) Partial pair* <b) triede and 
(©) q uadr uplet® with the method of paired oomparlson 
In which the eoaplete set of pair® 1® uead* ttm 
purpose i® to know a® to what extent those four 
method® giro the earn* result*# 




Thurston© (llS7i a d b) published two 




reBsar«h p^Nip<| la whioh he developed the law of 
aOfflpsrativo ^Mtonoot* It itiiawo that fof a Siren 
stimulus i there is associated a w>et frequently 
aroused modal discrimination proceed on a psyehologi** 
aal continuum* He defined the diecrimlnal proeeaa &*» 

* that proceed by which the organism identifies* die* 
tingulahes or react# to stimuli** so dleerlmlnal 
proceed ohangee from time to time due to Momentary 
fluctuation# in organ! oat* Ha further assumes that 
the distribution of all disortmlnal processes aroused 
by stimulus 1 Is normal about the modal discrimination 
process* fhis distribution has modal discrimination 
t* as wean or mode end discrimiaal diversion q ♦ 
Suppose there is another stimulus 4* ehioh is also 
to be iudgsd with respect to the same attribute a« 
stimulus 1 has been fudged* Suppose it has as the 
modal discrimination proses# end *j as discriatinal 
dispersion* 

Since the dieerlmlnal processes of the 
stimuli i end 4 are assumed to be normally distributed- 
the difference of these rariablee are al.ee normally 
distributed with ^ as diserSainal diversion 

B ri i r.w .in * iii i s nr in r-T'fr ■ ni ■■ ,,n 111,1 m «* m 



is the standard 





s i^ s 4* 

n = the standard deviation of the die* 
criminal processes, 
aj = the standard deviation of the die* 
criminal processes 83 

= tiva correlation between and 

The scale separation between stimuli 1 and 
j li expressed by Thurston® as 

Where 3* and Ij are modal discrimination 
processes of stimuli 1 and j* The value of normal deviate 
Zl j corresponds to the proportion of comparative 
judgements p l4 * that is, the proportion of time# i 1* 
judged better (or greater) than j* **th further 
assumptions that for all i and 5 and enuality 

of inter*correlations ^ r) ee find __ 

Z ^<j s!S^ (j-V*) T . . ■'" "' ITn ~ 

further m may assume a common wit of measurement fttt 

such a way that 

••y «a? 

%* -%*,$ 

n / 1 

from 't hi s it follows that the mew scale 
vale* for the 1th stiwtas may he represented by 




XJviJLb formula 18 helpful ia 49^#inilntol ^ 
aeale va3.uaa of the stimuli from th m Knowledge of tlia 

3Jhe number of ©ompiet* pairs of a stimuli is 
given by * If there arm IS stimuli* than the 

aorre spending number of complete pairs t« jy|g|$__10d* 
In the complete pairs* if there are n stimuli than 
eaeh stimulus occurs once with a-1 other stimuli in 
the group. It msaas* that every stimulus la the group 
has got equal opportunity to ooeur with all remaining 

stimuli* 

Ross JUt*U»»*) has given a schema of 
presentation of these oomplsts pairs to the fudges* 
m gives *©pti»al* orders of pressatatiou of pairs 
for the number of stimuli from five to ssvaatesa as 
wsll as a general method for calculating ♦optimal* 
orders of p re sent at is a* 

Bis orders are f optimal* ia the seams that 

|.i>' Rash stimulus appears first *t half the 

pairs of which ft is a masher* - w 

Ciiirairs haying e*e stimolss -d* agpsmei, are 
separated ia the orders of presentation* 

•• ,ciii> there ia me detestable pattern eg 



PARTIAL PAIRS 


A* in tha coop lata p&lvft* if there are n ftti* 
each eiiisulua occurs with All I a*l fttiaoli of 
th# gyoisp * Thlft ift o&t the otl® with piftlal ptlft* 
la the parfetal paira# each stimulus in mat paired ***** 
ail the other atifflull of the group« hut only with i 
gow of others* However the nowbcr of tiw#® any atlnulue 
ooourft with other atiauli la fixed* Total u^or of 
partial pair® 1* given by flj§ > where si 1« the total 
number of etiaull we® a la the nuabef of tlaee eaoh 
atlanlua oooiMPft with other a* Partial peite are balanced 
In the mee that each fttioulm# get* equally rapreeented 

in the net* 

Kephart and Oliver (19031 gave the *dea •* 
gate for fomation of partial pair#* A eat coatsine 
mlnimue number of paira§ which would geraft each aartsep 
of the group to occur with other# equal m«&er of **heft* 
total naaber of eete in complete pairing i« given *y 
i | » i ( abate a it the sumher of total at fault ia the 
ipl*, mm iMti katMsM *w»p at MMMi'WnAaa 
pair#* If the' use*** of etiauli f# odd* $#***1 *w»fe 
get would leesetet of a pair# ene t» ovary ' 
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If fchara 1* «n awan auwlbaf of stimuli, th»o 
tm» iMt #o% will Contain m&gr J£* pair*# flaw* fo* 

m 

a 4} t&ara will a* oaa oomplata Mt «wl fcfca wWwMf 
set will oontain only Half *H* of paif&* la 

aw*f7 sooplato *#t «**& atiisEulu* got* **oroa***t*& 
twisa, utolla la * Half **t* ***** wisfea* 1* 




Mo Comtek and 8eofcue (IMS) and Mo Cormiok and 
Roberts in two e lonely related papers, formed various 
schedules of partial pairs estreating various balanced 
sets systematically from the original set of complete 
pairs* Originally they took SO persona, employed in s 
factory as stimuli, which were to be Judged for their 
efflolenoles in the work by their supervisors, so tha 
rating task was assigned to the former, under whom 
these R0 persons already walked* 1225 pairs of 50 
persons were presented to those Judges* From this, 
information for various sets of partial pairs, were 
collected and correlations of the partial pairing scale 
values with scale values obtained by complete pairs 
were calculated* they found that in place of complete 
pairs, partial pairs were almost squally effective* 


Me Conslek end Boehms Cl&fla) also gars a 


systematic method for getting partial pairings in which 

•> 7 ) , St 

as lection of pairs is random# All stimuli are randomly 
assigned to positions along the borders of. its Judgsmsat 

■I ' V' s ‘v 


matrix and then selecting sets of matrix diagonals* so 
that all stimuli enter into tho sees number of comparisons* 
They took a group of 90 stimuli and formed four schedules' * 
of partial pairing* by tbs asms method as fellow*-,.! 



24*89 


16*20 


12*20 


mm atb partial par lag man* that a stimulus 
is pairs* with « out of b other stimuli whils ths total 
group sonslets of b 1 stimuli* This notation of partial 
pairing is ussd by previous worfcars in tha fluid* Thsy 
found that ths corrslations of soals valus* obtainad 
toy various sohadulss of partial pairing with thoss 
obtained by comp lata pairings ars almost dlraetly 
proportional to ths numbsr of ssts fro® original 
oomplate pair sots* thsy ussd in ths partial pairings# 

Olivsr (1962} oonduetsd an aspariment to find 
out sorrslations batman partial pairing and soaplata 
pairings after dontrolling ratsr un*r#llabllity 
experimentally, ha found correlations ranging from 
# @45 for 2*49 pairings to *996 for 24*92 pairings* 
Average oorrslatlons for 14*29 pairings varied tmu 
•99 to #99* RelittbllitJaa of 14*29 pairings among thsss 
partial pairings that wars squally abbreviated and 
mutually exalusive rsngsd from #222 to *924* 

0s Oraakan (19*9) tUMd 29 m aloSSif lost lent 
go stimuli* ■» formed partial pairs randomly ss-lsating 
mm sat out of original 1.2 ssts of 9#' 2a 

prsssntod 12 iota to the tutors-* Pi ^2N9lMi2'# - 
norm lotion of #99 batman melevelmte Obtsinad t>y 
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randomly selected set of partial pairs and complete 
pairs* In all the above studies* the data utilised 
sere extracted from complete pairing matrices. 



Hanbo (1939) empirically eon^arsd the comp* 

lets pairing of 30 stimuli and flee partial pairing 

schedules* He used for stimuli 30 nationality group 

names, which hare been extracted from the Borgardua 
* ? 

scale of social distance (194?)* H» used independent 
groups of 10 independent raters for each of the sis 
rating schema** 
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He found following correlations between the 
scale values obtained by partial pairing and tboae of 
complete pairing# 

Group v 

A >93 

fi #91 

G *9® 

0 *83 

a #T? 

fie found that with up to the 4@d reduction la 
the number of pairs# partial pairings resulted lad to 
high correlations of order #93 with soalo values 
obtained from complete pairing# Be remarked that in 
previous studies correlations were found to be 
comparatively high but it was due to the fast that 
the data extraeted from (template pairings were utilised# 

Allan H» Starry# els© empirically eompared 
partial pairing and ooeplete pairing methods# fils study 
will be dlBouesed later In this chapter# 


a tried eoaeiste of three stlMUli-# ©shooter 

(1988) remarked that it is readily apparent that tht 
partial petrla# technique does net fulfil the regime 
meat* far bats^ce. *£*'& fttpaoi to the, 





stimuli seals-vsXuea# He suggested that balamed triads 
presentation would help the situation, where law 
numbers of stimuli are to be sealed with equal accuraey* 

In this presentation* n balanced triads serve 
tha purpose, whan corresponding complete pairs era 3n 
in number* Wont of tha judges becomes J3/3 of original, 
which they are expected to exert la rating of complete 
pairs of oorraspoadlng stimuli* 

W«W*R#Ball obtained triads by oyelio anumere* 
tion of configuration* Ha gives solution triads for 

tr 9, is, 21, a?* as, a»* si, 0 ?» da, a*» ? 5 , ai# 
@7, as and at* The number of triads for a group of n 
stimuli is given by tha formula ftfeU # Ball Hot 
given the solution triads only for a 1 * which ara odd 
multiples of three, and are 100* 

OOMPARISOH Of OTlgg 

mmm m mmm 


Alim a* a tarry Ut$7) oonparad these three 
methods of sealing 1*»* collate pairs, partial pairing 
sad triads* m eeleeted, developed *ad utilised « ata^r 
of apparent sis# oonduotad by Oraatogrt■ il£g0)* 
rat ers •iwagg SO volunteer• of psychology department. -of- 

tvmm **fc*ip*w** *i* «*w»» *•** »**w- w ^ 
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3J eseh* Coop lets pairs and partial pair® 6il4 war® fomed 
a® suggested by Kepphart and Olirer (1833) and ©liver(1963) 
p©r triad® th« astiwd u«ad was of Ball as suggested by 
Sohuper# IDs whole rating work was dona In six mmi&m 
&t 30#8G minutes* For each form* two independent groups 
rated Independently in two sessions* Results of W* study 
are noted below* 

The underlined figures are obtained after 
applying correct Ion for attenuation* 


00RRUUT10K SSfWSSSS YAW 

THE DIPFEftSSi METHODS OF SCALING 


Method 


id ******** 1 11 w ++*mmmmm*rn« 

Partial Triads 


*®raabertp 
original 
pairing* 


coaplete 

pairing 

*39 

M 

•83 

•91 



Partial 


^91 

.88 


Triads 



•88 

1) 

;_ 


For each method Is®" abbelsdt ■ 

reliability that range* between *99 add' a&t* Bis study 
shows that the use of partial pairing and triads are 






almost equally effective# in hi® experiment Ball«s 
method was und to form sots of balanced triad® of 
stimuli, Tha method is applicable only whoa the nuafcer 
of stimuli n la odd multiple of a * 0ox (1W0) extended 
the principle of cyclic enumeration of conf iguration in 
Me paper on Enumeration end Construction of balanced 
in complete block configuration**» By Ms method* 
balanced triads can be obtained for all such n for 
which n(n*l)/e i* an integer# 




though there does not see® to be any study 
on the use of Quadruplet# for sealing* here the latest!* 
gator made use of a balanced set of quadruplets also for 
sealing * The idea was to try a alspla extension of the 
triads technique« The designs of the balanced quadruplets 
are provided by oohran and Qox in their discussion of 
balanced incomplete block* design* in the Quadruplets 
loathed* 4 ftimuli are presented at a time to bha Judge* w 
The effectiveness of the quadruplet method will be ^. 
compared with that of the ether methods# 








U) Collate patfiat 
Cb) Partial pallia* 

<c> triads 
Cd) Quadruplets* 

pur th«t a eat of 13 activities 1« seleeted 
from the leisure time activities of young boys* A suitable 
design was used that made it poseible to coopers the 
four methods* 

(a) a* used on four different groups of bey* 

(b) aft u«id on tbs ftame set of boyft* but with 

the eounterbalanoing of order effeotft* 

Here teftft resesreh hypothesis is that the 
methods using partial pairing f triad# and quadruplet# would 
involve Isas time compared to oomplete pairing and 
would give more or lees ftame rankings and seals -values for 
ths 13 stimuli* the investigator haft seleeted the 13 
stimuli which am activities to bo ranked in order of 
preference by the students# thus there may be a large 
disagreement among students in the matter of preferenee* 
the investigator will see how the different technique* 
oompare in sueh a situation# 




pitta* of aenpXat* pair*, thm us* of w&lan i* ganarnUy 
Xlmitod to th* ©**» ahor* tt» owiabop of stimuli i# oot 


largo* 






in tfeia ituay tha fw ©f wnliag 
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ada la ii&ottld not aegloet thS* egpoot of 
eetion* thm method of p*irod ©omparieon* end otai#r 
method* hm m likely to *iw fairly «*««**** »®*lt 
rains* for the yarioo* aotiritio# preferred hy ttoi 
•indent** 


qf toonnaaft 

For the purpose of thle study, *» defIn* 
laieur* time a* the time student* got in the after aoono 
after finishing ihoir college hoof* and doing 
assignment** Xhoe* astir$ti*s or* taken into eensidera* 
tiong in otHtfont» usually tndulg* for mental 

refreshment or reareatien* 


fhe l**y**tigator vliltii the efcudeiite of (Slate* 
XI in the «l*g**ree»* and talked with them *heut their , 
utmiiftf in th*ir leiewre hem* E* oeaeuragad tfco 
student* to giro inforootione *&*«t their proforonooo 
to the eotivltioOf in vhleh they wish to Indulge in 
their liimi* 

they oore pot ttoe feilewleg * 


m Met «U‘ MmA» 

in row lot:am Mm* 

|h| gate mash -time 'do yes* d*WS$e thnee 
leisure tine retieifciee* 

(a) If p$#e£ht»> gMeffg *f*», the 

fcfc.ac'Mfia®*" 


*kSfobggBlwB!w 








there wee a food response* From these the list 
of activities wee prepared* According to their preference* 
the activities were listed In aerial order* Hoot of them 
indicated that they devote at least one and half how 
in the evening ranging from fi F*M f to 8 F,M* total 
mu&er of aotlvitlee were 87 in the list* 

the design of experiment was such that every 
dw&ge (student) had to respond to four forma of the 
oplnionairea Ci*e* oomplete pairs, partial pairs, triads, 
and quadruplets) * It was not possible to select a large 
number of stimuli for this particular experiment, 
because of certain practical difficulties in admlnio* 
tration of the opiaiemairee* It we decided to select 
13 stimuli* A© this is net odd multiple of 3* Ball** 
procedure of forming a balanced set of triads could 
mt be used* However, from the balanced incomplete 
blech eonfsgurafcions presented by dehran and Goa in 
their bow on *®xperi«eatal design*, it was possible 
to get a balanced aet of triads for this ease of 
a 18* 

■ , U * 

Gut' of the previously prepared list «F it v< 
activltiea, M activities here b mm aeleetsdt vfeiefc _ 
were the mere- preferred then- otshewu the** were 

j r f * 

pr»mat«t to Wait *«» **• tfw* *» *»•»*** *4* 

1 1 r r i ifc-fl 
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franelated into Snglieh these iw i 
3.* Seeing a fila. 

3 * Binging er playing a miloal inatrunettt* 

3 * Ooasipping friends# 

4# Walking in ©pen ply# 

5 * Seeing a matoh of arieket* bpekey at#* 

6 « Beading magaainee# 

7 , Beading news-paper# 

8 * Beading novela* 

9 , listening to radio- 
10* Chit-Chatting with family swabefa* 

11 * Belaxing in a guiet plaea* 

18* Playing out door game** 

13 * playing in-door garnet (eards* earrom «to«) 


fov preparing the sohame of presentation* the 
investigator uaea the nwafeer of stimuli at given in 
the above Mentioned list* Four feme of ©piaiennafree 
are to he prepared eerreepe n d lng to the fear nethede of 

dealing* thee© are described below i 

> 


(|) Cotapil»te,-pair fom* the total ees&ey of 
eeaplete poff© mmepeitliiii to 18 toti*t|ie« _to» ft# 
Bom CatCMMi ©ei •*©•» © eehme of'fr©i©nietii$ if .1ft*# 


pair* ta an *0p ttinel* order# ©f wfciefc a 'taewitm heo • 
teen setae 'in Chapter x# ell the pelwi or- the ifr etieuli 
mipe (gfranged eoeording t® the seise®© eoggeetwi: ©if 
St©**. in the appendix <i-0) dpeoigigi-' dOpjfrif tip ffcdlfv 

s. * - ’ -<7A J C,* ’ i *! V**?/'■ *■■ Z \ ^ ‘ ' , a *' '\ r - V^f /Cy 







in given and in appendix A-&* final form of complete 
pairs prtHolattM 1* given* 

t^SMSSSM 9 

Instructions ts ti*a* tladfifits) waif® 

ilven In Hindi. A speeinan copy of the Instruction# in 
Hindi | which were given to lodge# with complete pstvtai 
fen in attaehed in Apptndix A*&* Xhn students always 
f««l afraid of giving in correct answers in an exani** 
eetlwultuatIon* Far veaoving this fear* they were told 
tftj&t It 1# not the examination and only their preference® 
were to ho expressed for certain activities and there 
ta no wrong or right answer* Also they were toM that 
they should not take undue tine in expressing their 
preference* * fha actual last root ion* were* * Beer 
students* After finishing school work, every student 
indulges in some recreational activity in hi# leisure 
fm the evening* with help of this opiaioanaires we 
went to know what activities our student# prefer In 
their leisures* This is not any type of examination* 
m there is m wrong or right answer* Only that .sower 
is right* which is according to your choice* 

m this epin^Mslre* tmtwm 
are presented in the form of pairs* first resit «ee 
fully noth wtivtties of the pair* ***** 
whiWt activity do you prefer out or «**»'*** only 



that eotlvltf ahould to© tidfc narkod t y)* ** 

exftiphi ©a© pair I* giraa b«low* 

1* (a) Writing lattavs* 

(to) Flying a kit©* 

0 a 9 f who ©^raaaad this oploiorai Ilk©a war© 

©atlaity*a 1 than aatirity'to' or ha lUt©* oor© (a)writing 
Xottara than (to) flying a kit©* 

la all pair*# aaaordiag to your oho to© plan© 
a tioK-atartt €_/> on (a) activity or tb)* Do not plan© 
tiafc (V> 0Ek hath or 1««« both unmarked* In 

©•looting your pp*f«ram©a# do not go with tha opinion 
Of your olnaa fellow©* only your opinion ia important 
for your profaroaooa* Make ha*t©» a© you ©an* tout 
tohar© la no r© at riot ion of time* flak “marts y®W 

ohoioa* 

V ARTlkL P*X* FORM 

la thftc fora thor© ar© 38 pair** whiah la 
ef tha original oonplot© pair a# RoOto©** «t«aly 
indicated that partial pair** *<*&!» tain©© olnaaly 
approximated to thoa© abtainOd txm a o@opl©t© 
pairing* whoa toh© mwstooy of pair* «o* Mi Mr© of 
tha nuahor .*» ©««pl#t« padri&g# furtt*** raduafclom Ml 
to raanlt In a mar© «*riou© nadlf ioatdoa S* anai©* 
talugtt ototntngd* But *Um» gitttei' ■ '-v 


i-1 





o o rp#lutloft bvtidWtt wil**falw** '*itt* SiH 
^atlial pairing and «o»pl*t* pairing 8»ii»d** ®*r 
Itaaping in *i#w tbi jftiuHi ®f tJfw*** ttuilit a 
6*1$ partial pairing twt &**n naad* 

thtt iawafcigator uaad Ha Corniete and 
Saahua jaatJxadl to form partial pair** na* tb* 
pm®#<liir® by hiwi tba following 1 3x 1 3 


matrix 1* ua#d* 





Iter foraing the partial pairs by this Mhwi| 
stimili are planed along borders of the 3udg«B»nt 
matrix | than eolaat too lines parallel to diagonal* 
so that %he total auafeer of sells* afoioh are grossed 
by these lines* la 13* the arose <X) »«y be asFfcod 
In all these sells* the so-ordinates of these soils 
constitute a balaneod aet of pairs* Here 8 aata of 
complete pairs have boon obtained a« shewn in the 
figure* for that six line* parallel to the diagonal 
had to bo drawn* Hare eaeh stimuli!# eesurs with 
others aix tinea only* •© the total noafeer of pairs 
la MJ&JL 3&JL& at In this softens* and it ear 

g 

he reforrod to aa Oils partial pairing sehewe* 

In the Appendix a<* 4» the nebon* of partial 
pair arrangenaat ia glean* the Sneeatlgator tried to 
keep maximal separation of ooaaaon aiiwuli pairs and 
eenal representation of these 'in the first plate and 
seaead plane ia a pair to got so optical order in 
presentation of these' as Mas has suggested* 

Finally the ingftoff ore replaced by ofctaU* 
In the iopondix Art* a <*epy of final partial pairs 
f mm with Immmttmm t» ft tea* Insbrnettenb are the 
sane as elm for mm$Wm psiri*'; " 

, , w r ; B f r.f?? ■*' ■' *' \ J - I'M-'rJfy v* 

1 p * 

/ ' W 1 

I I _ «. «l 






TRIAD & 

Mv** for 13 stimuli* the nuBfrera ©f baleneed 
triads is sirs© by the formula , £E|?M j£ , „|-iS 84» 

00 there are a® triads, whloh is 1/3 ©f *©*»* ******* 
of oomplate apairs* The investigator used 0ox*« balanced 
in complete ©look ©oafigurat ions, which gives balanced 
triads for all those eases* in whieh *• ** 

integer* 

For the purpose of this study the investigator 
uses Flan U*al on page 4*77 of Cohran and cos, © »»*•*** 
mental Dealgx*** which is reproduced in Appendix A*S« 
Finally the atasbera are substituted by the correepending 
stimuli and the final form of triads so obtained ia given 
in the Appendix a« 7* These triads are balanced, in 
the sense that sash stimulus is represented egusl 
number of times and the sash activity Is exactly 
paired ease with w every ether nativity in these sin 

sets* 


ter t h i s jfejht'dd presentalieh mdse $f the 
instructions are ths Sana as for **#**/*# - 

partial pairs*- ©air *h* instruction* *» ©*#*#**''*&*** 
preterm** «* «*»•*«>* ««• •# «**•«*»«• ■ 






tins ggjM of triads* tstaft law atigator 
iaatruats the iudg»» to «!»©»* t&* ao»t prefarrsd 
activity first* out of fcha throe ia any giwn triad 
and tiak mart: C/> *** **«!*» ***t out of tm&intm 
too* ehoesa ©no whioh to the least preferred. sad 
put tm arose ( X ) against that aeilrity# 

For txnoli * 'there wo triad is i 

1 *. x(a) Flaying Indoor gauaos-* 

^(0) Seeing flloa. 

<o) flaying ©ut«4oor gawaa# 

In this triad* suppose the i«dg« expresses 
tm mntmm preferemee to aoBing fihaa* so a tiofc- 
aarh C^/) is put against (h>* dlao ho expresses the 
Xoaat profsranoa to eotlrity playing Indoor gaoaa* 
oroaa CX) is put against it* tm student la asK«d t 
eaeerotaa his relative l«dgo«»nt only eons leering t 
throe activities of a triad at a tlwa* a oopy of 
detailed instructions* ohioh am gtwm to Judges* 
Matt is rspmduosd in the 


inWwniiT7B it h r 


Sh*»' f«ra « » *»ta»>*a ****<"* 

Han a OWMlW#!** *• * **W *f **•* * M *^ t *- * hl ® 






are presented together la a single Item* 

the Mt la balanced because each stimulus 
occurs exactly 4 times In the whole set* and each one 
occurs exactly ones la combination with every other 
stimulus# It la thus a balanced set In the same sense 
as the set of triads is* It may be noted that the 
set of Partial pairs was not balanced la this sense • 
there every nativity occurs exactly six times# but 
It does not occur® once la combination with every 
other activity* 

For the purpose of this experiment Plan 12US 
on page 623 Of COhraa It COx* *&xper$aental Design* Is 
used for forming a balanced set of quadruplet# the 
plan is repordueed la the Appendix A*d» Finally the 
numbers are replaced by corresponding stimuli, and 
the form so obtained la given in the Appendix A»® along* 
with the Instructions* 


In the ease of quadruplets also most of the 
Instructions ere the seme as in tbs ease of complete 
and partial pairs* Only the instructions to lodges for 
expressing their ^ndganenta are different* 


in this# the dodges are ashed to cheese the 

aotlvlfcy tta*y «»** fl*^Spa#*. > #g|p k w/m 

gtmmm M. m* *** mm 4A ti p * #e aMi* V* 


V-‘ 






remaining threw* they are aaked to eheoae the aoti- 
wity t which 1» the leaat preferred and P u t <*roaa C X > 
Against It, next they ar* waked to «aa*Sdwr the 
remaining two end ehooae the ad aetlaity, which la aorw 
preferred than other end draw a circle Q around It* 

For example*. eonsider w quadruplet 


i. © Seeing Film* 

(h> Flaying indoor game#* 
xCo) go lasting in a dtfMA plane* 

Flaying out-door gawww* 

fere %aj 

sest out of the four* A tlok-mark *® P ufc ******** 

it* if the leant preferred out of remaining three i» 
tC> * then aev**s <X> i* put agaiaet it. Out of 
remaining two law la anted to ohoeae one, whieh he 
prefer* were* If he prefer® (a) ewre and aoeording 
to the inatruotloua he drew* eiraletOaround It* 


fear »ti 


in Appendlg get* 




Before the fa*a.ptetiwn* 
etudent* were **#sed to fill ^ ^ 


gg«M the 

i^Ptineettwni 

1 S I 

I 

" ' \V I_ 

- 'I , , 

. ,i ' ,j -, y * ,rv.' ^ >■ 

■l- » ‘ Xi >-f>' -S 
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lti Ham i 

e* Ag«i 

h«m of th9 iDiBtltutloni 
4# ClaM* 

JIBS*. 

lte»* four fora* ww triad out on ®*oh of 

four atudonta or cun XI aueoaBaiwiy. I* fcl-0 
tokott by aaoh student w*» about S 6 ulnMtao for ail 
tboM four method*. 1 ‘hoy followed lnatructlone and 
workod accordingly, Apparently thaw w *» confusion 

and they oo»pXctad their taak proparly without laaVSot 
any pair* triad or auadruplete unearned. After thin 
try 0 ut the tool was wady for tu* purpow of th» 


i 


i i 


y\ V ** > 


k" l| 


t Vs 





In this Chapter* the proasdurs for setsotlon 
of sod tbs da Sign of ejtpsrlasnt will bo 

described* 



ths Investigator oho so W students of first 
year In the Intermediate College, Seflfeh Kbsde, dletrlot 

Mathura* They wars all of hsnanlty stroan* ihs total 

enrolment in the first year ols*« **» •“** a °* *** 
ranis of students wss M to 80 years. The students 
belonged mostly to alddlo olsse agriculturist f so Hies. 



laessl population of the pises is only afc&ufc 

j ^ % 

three thousand. *!**• **• only two isntfci*. * 

rot itudsnt* W* * 

— ' jJ i* 


J.-. TP 

r Ji. i- 


«m'tmw i 




*31 


QhAVa 

U) fi COLLaQK j. 

Collage ha« got playing field of 8 noroe* 
Facilities aw BVlinbJ* for all major out-door game* 
i»o. Hookey, Feot*ball, Volly-ball, Crlohot etc. She 
Physical Instructor of the College U an efficient 

youngnau who slway* encourages «• h0 * B t0 play f5MW “ 
and coaches them also. 9ot Indoor gamoe* there ew two 
or three sets of Carrom-board*, but there Is no 
arrangement for table-tenni* etc. Shew tw ° B ° t8 

of Harmonium, tabla, Dholkl, biter for training the 
hope to participate In drama. It le worth mentioning 
haw that nolle go has got many students who elng wall 
and who are trained for toting past in drama and 
musical programme# at the district and regional level. 
Library facilities ere eatlefaetory* Ihew are 7000 
hooka m tt» library. Bwry student le entitled to 
draw two hooka for a weak. About 40% boya use the 
library, fhara lr a reading ww too, whew the boyt 

0 «i ait and wad any thing they *«»• «**• w * 
adequate number of new. papere and magaainoa available 

There la also a radio aat and In the waeae they can 
he»r news and music on radio. *b» wlldge and the 
neighbouring achool* co-operated well with each 
other* Friendly matohee of Hoehey, Fooft*baU ate* 
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ttr« often played by the atudanta, It U ft eo*eduea- 
tlonal institution* 

fhls le the eeoond oentre of attraction* It 
hae got radio* material for Indoor games, as barren 
aheeftf playing oifdn eta* a reading room i# alao 
there, which has soma papers and aagaaiflee* Sobs 
nueleal lnetrunente ere alee kept there* 



the do student! were divided Into 4 group#, 
at random* Saoh group aonalettng of 13 rtudenti* The 
deelgn of the experiment le given below* It le a letln 
square arrangement with multiple measurements on the 
iwae eubjeete* the deelgn le often referred to ai ft 


areas over design* 
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tABLgJt 

l.mn fl pg IBS DSSiW. 

. 



f JPBt 


Conflate 
Pair Form* 


Group 8 





Partial Tried 

Pair Form* Form* 


quadruplet 

From* 


Oaoond Triad Prom. Quadruplet 

FortDa 


Compto Partial 
Fora* Pair Fora. 


* hipa *-£■•« sser* 

SWL. wltdPew ‘ 


Partial Triad 

For#* Form* 

Quadruplet Complete 
Form* palv Potftn# 



To the first groupi tha aoaplate pair foiw 
ha« boon atalnlatarad first, then triads, than 
quadruplets at* finally partial pair® form la admlnla- 
tarad* Similarly for the other group., the four forma 
m administered auooaeelvely In the order. MtaM 
show. The Interval between a adminletratlone *« B 

to 6 minatta* 




Xfta following point* tf* worth noting i 
Cl) Snoh group ha* four admlnlstratlono 
corresponding the four method* of Booling* It m**n* 
that avery member of the group 1* required to take 
eadh fora, -inqa the preference for aotivltle* would 
Vary nun from person to person fqr a proper comp a - 
r i Bt >n of the methods, It i* desirable to obtain the 

response of eaoh atudent to each form* 

(11) livery form appear* In first* second, 
third and fourth administration* with on* or the oth#r 
group. Ihos th* complete pair form ha* been given to 
the first group In first administration, to the third 
group In the second administration, to the eeoond 
in the third admlnlatratlon and finally in fourth 
administration it i* given to the group IV. In thl* 
design, «aah form occur* oiu»o In each order and eaoh 
group get* sash form in one or the other order, thus 
with thi* design, th* 0 *d*r effect* are oounter 

balanced* 

(ill) In thl* design, memory of r**pon*** of 
one form may *«•<*■ ^he result* of «nb«e*u*nt form., 
hut not severely, because pairs, trlsd* and quadruplet* 
pe** different situation*. However, th* aemparison of 
few grow* only with respect to the result* of the 
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fir 01 ; ttdtfilnlptration of tte fowp fQfm& will W fwo 
fioai fi fty oRypy*OM , r offoct of raiiiofy* oloo 

been don* using the date of the first row only in 
teho table layout of design treating it >■ a simp la 
randomised design. But in this the error term would 
oonelet of eobjeot to subjeot variation* and would be 
oompnratively much larger. 

fHB BXPBfllHglTCi. 

I 

Iha inveatlgator fixed up with the Prinolpnl, 
Klaan Inter College, Gonkh BUwda, district Mathura,The 
tine to eonduot this experiment* the date and time 
fixed up were 19th March, iBifl at 10*30 a«M* 

The llat of the boye of first yaar olass In 
alphabatia order was obtained and with the help of a 
table of random numbers, 40 boys are divided into four 

groups of IS eaoh* 

Jn a room and var&itfla, SO a«at» with desks 
were arranged* the atmosphere was pdaesful* ®hs 
lecturers ©f the Institution were very helpful and 
eo-operative* One laaturor was assigned eeah group, to 
work a* *n invigilator for the group. Hie work was to 
distribute forme, oolleet forme end note the times of 
distribution and oolleation on eaah form* The 
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G ac to It that there was not be any type of int®r- 
oommunlaatlon among student®• 

tl» investigator than addrn»B®d the studsat® 
anA told them about the work, which they wet® * yinS 60 
do. they were asked to read instructions first and 
Man proceed farther, ft* investigator discussed son® 
point® About expressing their Judgements, which wer® 
already in the Instructions. Instruction® were enclosed 
with each form. With the Instructions In each form, 
an example wee there for illustration. They «*ere toM 
that inatructlone were self contained and they ihould 
not talk with follow etudents, If there wee any diffi¬ 
culty, they could read the InstructIona e*eln end even 
then 1# difficulty remained, they could e«k the 
invigilator of the group. They were eeked not to spend 
«uch time in expressing their Judgements and also they 
should not leave Ah? pair, triads or quadpup lata 
unm&tfted* 



lo*40 tta tfoTW* 

a® these were distributed, the student® got busy in 
answering 4** After g or 4 minutes, students started 
to get up end to glv* beak completed forme. Some 
difficulty mes faced, by the lMlflUten of the grouyo 
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in collating, cheeking awl noting the time. But the 
situation we handled efficiently, when the Investi¬ 
gator and the Principal, who were supervising the 
work, began to eolleot, check end note the time of 
submitting* thus * team of six pereone ware »ngeged 
in this task, with proper supervision there was not much 
Mm Intar-oommunloatlon between students. Maximum 
efforts were made to avoid contamination of result* 
due to intermixing or boys at the time of testing* 
the whole experiment lasted about 46 minutes. The 
students except on® student, found no diffloulfcy in 
reading the instructions and expressing their 
preferences* The one student, who did not seem to 
Know, which activities in a pair hs preferred, wes 
adked to read the instmtione again after reading 
instructions he was able to express his prefornd* for 

one of the aotlvitles* 




i 



m gasajau 


In this Chapter, oart&in Btetlotioal prooe* 
duroe for finding out soalevalue*, within retor 
reliability eta we discussed. 



AB Inti bean nndDMA in Chapter 1, Uhur stone 
aafiuMd that with a given stimulus 1 la associated ® oat 
C frequently aroused nodal discrimination or a psycho¬ 
logical continual with referanoe to son* attribute. Ms 
as mined that dlearlminal prooesees *»■ mornally 
distributed about naan or nodal dleorlmlnal prowess 
^ with a standard deviation or dlaorlmlnel Alapsrslon 
suppose there is another *tlamina J, which la Judged 
with reap eat to the aoma attribute, has nesn&j snd 
Standard deviation 

than, It t t > *S a , It nsnns that more than 
BOi$ of aubjeota say that 1 Is mors favourable ths» i* 
XJP f a , it naans that 50« subfssta prefer 1 
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to J and the otter flo* of the eubfleeta prefer 3 to 1* 

li«t f-j_ j is the numb a r of Bubjootfl* who prefer 
i to J. If B la the total number of aubfleots then 
Pjj 1° the proportion of aub float b prefer mg 

1 to 3 a 

tat , be the value of the etandard normal 
deviate Buoh that the area to Its left la Pjj» 

It haa been'pointed out ear Her, that under 
the aeBiauptlona that 


nihj*. ’ 1 

Vii. s ri^ t 

m* 




= X 


n-1,11 t.r 


A meaeure of Boole separation of the atimull 

1 and fl la obtained a* 

# . .. . .******* 

, -® t -ftj f where V a»»0- Y ) 

la taken aa a common unit of oaaanremant for defcalla, 

one can refer to chapter a of 'Techniquea of Attitude 

Seale aonatruotlon' by a*l*.d Bdwsrde. 


g-WATHlX» 

The flrat atep in determination of eoelavnluee 

aonalate of writing down the F-matrix that la, the 
matrix of frequeoole* f jj* In thla atudy, tliere 

a 





•r« n 13 stimuli, *o we obtain a 13 x 13 f - matrix, 
i'htt a lament f^, that occurs in ths ith row and 3th 
oolumn of tho matrix denotes the nuafcar or tinea tie 
Stimulus 1 la prarered over ths stimulus 3. It will 

ha obvious that gives 

total number of tinea i i» preferred ovar other 
stimuli In all the nH comparisons. 



In the complete pair form, there ere 7B 
pairs and la partial pair form, there are 30 palra of 
nativities* Kaoh JudB* <i«e* student} ia aaked to 
tloK-mark lj) the aotivitly he prefers more In a 

given pair. 

4 

Por example, one of the pair 1* 

3j<f(a> seeing a film (Activity No.l) 

(b) Reading mageslnes [activity Ro» •> 

In ths cell <l»«) corresponding to the 1st 

row and 6th column* a total bally 1 put. It the 
atudant prefara the first over the eeoond, and 1* 
he prefers the eeoond over the flrat, a tally would 
be put in the e*U 1,8,1) eorw pending to the «th 
vow and the first oolumn - the total or ell the talliei 
in the sell U,6) l« M * x » 6 aimllarly for every 
other cell the freaueneiee fj j »*• obtained* If 
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8 out of U student b pwfM 1 to 8 and th® M*t ® te 
X, than fl, ft 8 and fd.l 7, For convenience, k«y# 
wove used with tool® a punched on (a) or (b) whlohovor 
oorresponded to tW# nativity with lo*wr aarini number 
to obtain tha tallies in the upper triangular half or 
the f♦matrix* 


St aOuRlMQ OF ‘MIAD FORK 

Share are 88 triad® in the rorm* in the triad 
form, thfl judge tlok mark* ij) tha activity, whiah ia 
tha moat preferred in the group of three and plane# 
a arose (x) against tha activity which la tha least 

preferred of three. 

For example• auppoae one of the triads ti 

marked by a student * 

(a) Listening to radio (activity No*®) 

^/(b) Reading novel# (activity Ho, 8) 

X Co) seeing * film (aotivlty Wo* 1) 

Here since (b) i# preferred both over (a) *nd 
(o), one tally should be marked In each of the cell# 
(8,1) and (8,8) that it the cella corresponding to 
tha 8th row and I«t column and 8th row sad 8th column, 
Further since tha nativity <e) l* the least preferred 
of th# three activities, it means that <a) is more 
preferred than ( 0 ) and a* a tally should be put in 




* 43 * 


the o*ll (9|1) also that ths mil which comaponda 
to the 9 th row and tha 1st column* than in all 3 
tallica arc marked corresponding to each tried* Here 
also a key with holes In appropriate pieces was used 
far convenience* 

sgaaia^fc-tBg-euABQyg^^ 

Thar® eve 13 Quadruplets In ths set. Bars the 
judge takes three dealaions corresponding e given 
quadruplet* He (1) tlsk»marke that activity, Which 

is the vest preferred of the four aotlvitlse presented 
in the quadruplet* 

(11) marks a cross ( X ) against that activity, 
which is the least preferred of the four, end 

(ill) draws a olrale(0)round the activity 
which he prefers store out of the remaining two* 

.For example suppose one of the Quadrupleta 
is named as follows by a student « 

(a) Waling in open sir (Activity So. A) 

"/(b) Playing outdoor gone* (Activity No,1*) 

X(o) Listening to radio (Activity No.9) 

(d) Reading magazines (Activity No.*) 

In this Quadruplet since <b) is the met 
preferred of all the four* one tally should he marked 


f 

/ H 


1 
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Jn aadh of the t«U> (12,4) (18,9) an* < 12 ,8). Haw 
the o«11 (12,4) means the oell corresponding to the 
18th row and 9th eolusnn and ao on. Next einoe thore 
U oiTolo ( 0 ) math on ta) it «"*» the aetivlty 
number 4 U preferred over the aotlvitle- 6 and 9, 

Henna one tally la marked In eaoh of the celle (4* 

9 ) and (4,3), Finally ainoa there ia a oroee (X) 
against Co), It raeana that <d> J.e. the activity 8 
le more preferred than (a) J»®« activity B and bo a 
tally le put in tie oeil <8.9) which oorreuponaa to 
the dth row and ath oolumn. Thun for each quadruplet, 
olx talliea are obtained for a given student. Here 
again a key with holes In appropriate plaoee wa* uwd 

for the sake of convenience* 

OtilBIlMIdATlOH OF aCAlSVALOSB FROM 

FORM 

From the F-matrix (given in the Appendix A* 
10), fir at the 9 -matrix la obtained by dividing eaoh 
f t , ty N fete total number of auh3eofea* In the table 
(given in Appendix A-88) p -matrix la eorroapondlng to 
the whole group of 80* From the P-matrix, the ss-matrlx 
(given In the Appendix A-3Q) i« obtained, ualng the 

noruftl probability tafcWi* 




«46* 


Now elnao 


= Si- Sj 


vje aau write 




13 



J 


or 3 ' &i- ^ 

mars ^ la ttw *ror»«o of tfco oaolovoluo* of 

motor om lo »*» «f i« «•«“«»>> f«“ 
tho mean of the seals vain*** of all the stimuli. M«1 

l.*ly noalevaluea of other stimuli aw obtain**. 



In ona triad as many ooraparlaone ere mad* a* 
in a pairs, 'fhare are 26 triads, ao aorrespoadtog to 
3 $ triads, that* all! b* Bdtf) ?B irt*» Jud^nfca. 

Counting the tBills» in eaoh oall, tbs F-matrix 
(given in Appendix *A-ia) Is obtained, and dividing 
each sail frequaney W the total nuOber of Judges the 
P•matrix Ulvsn In the Appondl* *- 38 ) 1 * obtalnad. 

Finally with the help of normal probability lab las 
z-matrl* (glvon in the Appandl* *- 03 ) *• obtalnad 
tad from that, the saala value* for fcm 10 aotirltloa 
ara oalaulatad Just to the earns way as p for paired 

eeuip arisen method.. 




QUADRUPLETS tfORH» 


In the case of quadruplets In eeeh quadruplet 
gg many oompeitleone are made as with alx palrfl» so that 
a quadruplet becomes equivalent to six pair®. In the 
present ease there are 13 quadruplet® and correspond Ins 
to them there are 13x6 78 pairs judgement0* Dividing 

each cell frequency of the F-matrix (given In the 
Appendix A-13) by the total number of judge® the F« 
matrix (given In the Appendix A-29) la obtained* the 
P-matrix le then converted into z-matrix (given In the 
Appendix A-33) and ffom that the ace levalues are 
obtained for the 13 activities in the flame way ae In 
the cam of complete pair a* 

there ere only 99 pair a, w half of th* total 
calls of tha p-matrix (given in the Appendix A-ll) ara 
vacant | beoeuea one atlmu3.ua occur a with only *lx other 
(stimuli. not all* ho alx oaila la a row atm filled 
axA root of tha mils ara vacant* I ho JP-matrix la 
converted into P -matrix (given In tha Appendix A*a?) 
by dividing, tha rrequenoiea total number of fludcep* 
next g-matrlx (given In tha Appendix A*31> any ha 
obtained from the P-matrix with tha help of normal 

J 1 

probability lab la. She aum of all *-aoora# of a tarn 
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la divided by total number of times this row stimulus 
occurs with other itlmllt In thl# ease, this nuribflJ 1 
la d» this #111 dive th# soalevalue for ti» few stlmu** 
lua and similarly so Rle value# for all other stimuli or* 

found out. 

In calculation of sor leva lues with partial 
poire, one point may be observed here. In the oaa* of 
40tiipl«t;e paix*e 

4MM W 

Jfij s; 

where 3 le the arithmetic mean of aoal*value* of ell 
the stimuli* 

In the oaBe of partial pairs* the mean of 
ss soarss of the 6 oells of 1th row has been taken so 

that 

*w **■, TV ■ 

H - s * 

where la the arlthmetio mean off the aoalevaluee 

of the 0 stimuli, with which 1th stimulus ooaure, Hero 
an approximation l« Involved. may aonsider 
to be approximately equal to a as the former mean le 
baaed on a sample of 6 out of 18 stimuli* 

an approximate procedure to be used when the 
number of Judge • la email* The procedure, described 
above were followed fo* the use of total sample of 
60 atudents for each method* while dealing with ttai 
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date of only ths 1st administration, where w® have 
data from only 16 students only for each method (given 
la Appendix A-28 to A-8fl)* fhe a-matrix **■ not 
obtained from the P •Matrix, In steed of that the 
row totals of frequencies was obtained from the F* 

Matrix and these were divided by the maximum sum of 
froquanole* possible In all the malls of a row* 

F-matrlx (given in the Appendix a- 33 to a-88 ) are 
to be used for calculation of acaievalue*. 

In the case of damplate pairs, triads and 
fuadrupleto, this maximum number le 180 snd In the 
ones of partial pairs this is 90* ?hu* for eaoh 

stimulus proportions were obtained. Sheas proportions 
were then Converted into sJ*s«ov«s, giving ths scale* 
values of the corresponding stimuli* This method Of 
finding out scale valuee te suitable, when number of 
Judgee le small. It provides a good approximation for 
the scale-values of the previous method. In this 
loathed the F-matrix is not converted Into P*Matrlx end 
z-matrlx. It can be shown thet the ratio of the 
difference of sealovalues obtained by those two methods 

Is constant* Ihus If TJi Ig ■**»«••** ^13 *** 

values obtained by the first method and x^ieg **-**13 
are the seals values obtained hy the second method, 

then It may he shewn that 1 





• I • 


Constant 
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*i* *a *a - *a 


IflTBR RaXBR Eiai.XABIi.IlYi 


It wae not possible to sd-ilniatar the oooo 
forsn of the qua at Icnnaire again to the awao in orfloif 
to da to min® the test - reteet ro liability • Xo got 
an idee of consistency the split half reliability 
WB calculated by dividing the students into two 
equivalent group*, orw person was omitted «t random 
from each group of 16 end the remaining 14 wore 
divided at random Into two groups of 7 osah« Thug for 
the complete pair# method It wae possible to form 
two group A end t of 89 each M follow# •* 


let Group 
Xlnd 0roup 
lllrd Group 
jvth Group 


Group a 


Group B 



7 


7 

7 

7 



Xhuo for e*oh wetnod ( two group* of M 
members have boon formed. After preparing r-matrix 
(given in Appendix A-14 to A4B1) for «»** h ot> theee 




two groups separately. then f repuenolea in eaoh row 
were totalled. Produet moment oorrelation between the 
total row fraquanoloo of these two group® were 
obtained for eaah method* then by applying hpoartaan 
Brown prophaoy formula* the correlation* for the whole 
group of 68 wfcpta aleo oe'tinifttadit 






chapter y . 


I» this Chapter, the Btatiattoal analysis of 
data la presented and the main results of analysis Rta 
presented in tabular form* 

AS has been explained earlier, 50students 
were divided at rendow in four group* and in the firat 
inatenee the four methods of sealing aero administered 
to these four groups. Thus for eaoh form there were 18 
respondents and the four groups oonsjsted of different 
students* this was like a simple randomised design* The 
bo alevalues for the 13 aativltiss obtained from these 
data are presented In table 1 and the analysis of 
varieties for the time date in table 11. 

further to eaafc of these four groups the other 
three forms were also administered in a latin square 
pattern to oeunter balaaoa the order offsets. Thus the 
date oorresponding to the 4 methods were obtained from 
•ash of the M sublets. The seals value- obtains* for 

the i» nativities tnm the •*» •* BbudentB ** 

thla *ay, are presented in table 3, and the analysis 

Of ISW ttW A ttt Fducatligp 


\ 




Other tables give correlations between ranks 
of the stimuli determined by the four methods, split 
half reliability for each method and other comparison 
on time data* 


sq^«musa AMP HANKS i 

first the data for the 4 Independent groups 
consisting of 15 students each were analysed* The 
&oale*veluee corresponding to each method were obtained 
by the procedure described in Chapter 4 * To calculate 
the scale values reported In table l t the 2-Mntrix 
were not obtained, but from the f^iatrix directly the 
proport lone for each stimulus (l*e* activity) were 
aelonl&tsd and transformed Into z* 




XABUS 1, 

h i p nm 'W * > m # 

Saalevaluas based on Independent group* of 

16 student* only* 

$r*5oSpis«r~TOttn- mm —^fupieSi 

No* Pair*, Pairs t Group 0, Group tt 

(Group a) (Group B) __ 


1 • 

■*286 

**729 

*•922 

*•802 

8* 

•600 

•089 

*•164 

*•386 

3. 

■**820 

*•780 

*•882 

*.066 

4* 

•898 

•923 

•600 

•446 

6, 

• «M1 

•Ida 

.141 

•432 

0* ■ 

••070 

*.063 

•197 

•310 

7. 

•282 

.423 

.380 

.007 

6* 

.043 

•303 

*210 

•826 

0* 

.382 

.230 

•470 

•869 

IQ* 

*••043 

*030 

*•088 

*•098 

11. 

*•327 

*.706 

*•208 

.898 

12* 

•788 

•000 

•904 

•493 

13. 

**070 

**024 

*1*190 

•1.317 





Soalevaluee, obtained by each of the four 
scaling methods applied to the same eat of SO subjects 
ap© reported In table 3* Ae deocribed ©erlier* the four 
methods were eo administered that the order effects 
w©r© counter balanced* In this case the cell frequencies 
of F-matrix were first converted into proportions and 
then Into z-eooree* Finally ecalevaluee were obtained 
by averaging the z^fleoree. 




table a« 

mm mm i- l i w 

t 

Saalawvalues* based on the same set of 60 

students* 


1 

Complots 
pairs* 

Partial 

pairs. 

Triads. 

ruadruplets 

1* 

if 4 III 11 - ^ iflfr 0 ^*^^ 

<“*4729 

*.6463 

*40936 

-.6899 

2. 

*0799 

.0177 

•*0081 

*0316 

a» 

<**8678 

-.8043 

-•8033 

•*9064 

4* 

*3380 

.7172 

•6980 

•6813 

0* 

.1238 

•0266 

•1760 

•3636 

0# 

*0836 

*0176 

•1332 

.0868 

?* 

•4682 

•6990 

•4686 

.8673 

e» 

•1638 

*0297 

•1069 

*1412 

9* 

•4676 

.3843 

•4406 

•3828 

10 i 

<••1013 

.0026 

•,1690 

-•0289 

11. 

<•*8661 

•♦4787 

••am 

•*0663 

18• 

*7740 

•8080 

•7187 

•0020 

131 

*•9308 

••8273 

•*8612 

*8604 
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Similarly the ranks of the activities eorree* 
jKtndlng to the four methoda of eaallng am obtained 
from table 3 are presented In table 4 below* 

msM 


Ranke of activities baaed on the same eat 

of do studenta. 


S*No* 

or 

•ti» 

mnlua. 

Complete 

pairs* 

Partial 

pairs* 

Triads* 

Quadruplet a* 

ll 

U 

U 

11 

11 

S« 

S 

8 

3 

a 

3* 

ia 

ia 

10 

13 

4* 

3 

8 

a 

a 

6, 

0 

7 

3 

3 

6. 

7 

a 

A 

7 

7* 

4 

a 

3 

3 • 

8« 

0 

0 

7 

0 

d. 

3 

4 

4 

4 

10. 

a 

3 

0 

3 

Hi 

10 

10 

10 

10 

IB* 

i 

i 

1 

1 

I8i 

13 

13 

13 

ia 




In the table 6 the correlation* are given batmen 
the two sets of eaalevaluea of the la activities for 
eaoh sealing method a* obtained, from Group a and B of 
the students « halves of the sample of students* as 
mentioned in the earlier Chapter, two equivalent groups 
A end a consisting of 80 subjects aacrh were formed* The 
correlations thus give split half reliability for eaoh 
sealing method* The oorrelatlone in the first column 
are between seals values determined from croups of 88 
eaoh* By applying spearman * Brown prophecy formula 
to these oorrelatlone, the obtained values can Inter* 
prated es those that would arise from two whole groups 
of 09 students each* These are reported In the last 
column of table 9« These figures Indicate how for judges 

4 

were consistent in their judgements* it shows that the 
judges were consistent for eaoh of the seeling methods* 
Thus, so far consistency of judgemente le concerned four 
methods are equally good* 



TABW5 6 


Interpreter aonsietenoyi Correlations b«tw«n 
soele-values obtained from two 
equivalent groups* 


berlel Methods* 
number 


Between two Spearman Brown 
equivalent value for whole 
helve's of SB) group of SB* 



fable ft shows correlations between so ale - 
values* obtained by administrations of four forms 
(■deling methods) to four Independent groups of 
16 eaeh* Correlations of soele-values obtained by 
partial* triad and quadruplet methods with tha 
c om plete pairs method are »aa« *8* and *80* All these 
are significant at *01 and *08 level exeept the 
last one whloh Is significant only *t 88 level* feet 
of slgnlflosnee of difference of correlations by 

using the appropriate t - atatletlo reveals that 

. - . * . ^ - 


* *cs*»**l8 

.SKl*ri(}«*fJji•rSa+sriariarss) 
Btatletioal infersnse walker * lev* 




there is no significant difference between correlations 
ot (1) oooiplet# pair form with partial pair forma and 
oonp 1#to pair form with triads, and fii) oaqplete pair 
form with partial pair# and qomplate pair* with quadrup¬ 
lets* But there la a aigniflapnt difference between 
correlations of complete palre with triads and complete 
palre with quadruplets* fhe eorrelatlona between partial 
pairs and triads, partial palre and quadruplets and bet¬ 
ween triads and quadruplets are j <87* *70 and *B9 
respectively, this shows that these short out procedures 
among themselves are highly correlated. In table 6 968 
confidence Intervals corresponding to eaoh correlations 
are also given in parenthesis* blnce the four Indepen¬ 
dent forme are assigned to four different groups of 
students the variability among students Is likely to 
pull down the correlation values* Thera le likely to be 
large individual variations in preference of lelauro 
time activities* Therefore, the correlations between the 
ecalevaluss obtained by the different methods may not bo 
high, because In each method, a different group la Invol¬ 
ved* But the values we obtained are fairly high, showing 
that the four methods have a lot In common* 




*03. 


Inter Co«rr*latIon* between the toaling Methods« 
based on lndependant groups of 

IS eaoh* 


&* NtM of 
ho* methods* 


Coop3ot« Partial 
pairs* pair** 


Triada* 




cu&drup 

lota* 


complete* 


8* Partial* 


a* Triad#. * 


•BB 

(*49<? 
<*9d> 


•8i *80 

(*M<C (* 08 <c 

< *90) < *07) 


•87 *70 

C*6»<? t.BB<e 

<*98) < *90) 


*89 

<*«7<e 

<*97) 


Not# »* Within parenthaaifl 98* aonfidenoe interval* 
for r are given* 

Xn Tab!* 7* the correlations batmen the met hod i 
ar# reported on the beaie Of the data obtained from fcho 
mAtoXft iftt of SO otud®wto* 

Iha oorrelatiana between aomplet* pairs with 
partial palra# triad* and Quadruplet* are *97, *99 and 
•98. Xte otter oorvelatlone In table 7 ahem that theeo 
abort out procedure a of scaling #*• giving almost um 




*4a« 

reaults. xn tl» table. in ptrintteiiU) Intervals &t 9Si 
confidence we given corresponding to each pf the 
correlation. In cm case, with data from tha same sot of 
(0 sub Jecite. when correlations are calculated. these are 
naturally higher then those obtained from the data from 
different groups of 14 subjects each. 

TABLE 7.* 

Xnteraorrelations of Uaalevalues. based on 
Judgements of 00 judges. 


Method Complete 
pairs* 

Partial' 

pairs* 

Triads. 

Quadruplets 

Collets * 

*97 

*69 

«9B 

pairs. 

U9Q<e 

Cl7<? 

(»9E<r 


<.89) 

1*99) 

•9®) 

Partial * 

m 

.97 

iM 

pairs. 


(*»<< 

i.M^e 

Triads* 


<«9») 

<• 09 ) 

•96 

e»<e 

<U97> 


* The ME confidence Intervals of each correlation are given 


In parenthtsee. 

IBTBft OURRaLAlIQna OF lUUWt ORDSK8. 


In caloulatlng rente correlations no assumption of 
normality of the trait is made for proper interpretation 




of the values* la the ossa of small number of stimuli. It 
Rank qo mo lotions wavs therefore oaloulated to get supple* 
mentary information about the alewoMB of the results from 
the four methods* 

In table g, are given correlations between the ranks 
of the is activities obtained by the four methods of sealing 
as applied to four Independent group b of 10 each* 

These oorrelatlone ware calculated from the ranks 
reported In table 3« The correlations are all fairly high* 



Inter Correlations between ranks based on data 
from the independent groups of 
16 each* 


Method 

pairs* 

Partial 

pairs. 

Triads 

Quadruplets 

complete 

pairs* 

- •» 

•6a 

•as 

Partial 

pairs* 

* « 

*90 

*78 

Triads* 

m 

* 


•Ba 


In table 6* similar rank oorrelatlone are reported 
from the rank* given in table 4. All these correlations ars 
high* indicating that all these four methods are almost 
equally effective in ranking a given sat Of stimuli* 





Int«r Correlation* of teat orders f baaed on judge* 
wants of the tame eet of fto 
student a, 


**^ t *** 4 *** , * ,>l * t, *' | w || w , | e ** | w w iso e^tow^na —ep»sHM P*s>iK**ie^aiMb^ i **we»«woM*»^0 | *soSeo>ios 


name of 
method* 

Complete 

pairs* 

Partial 

pairs* 

Triads* 

Quadruplets 

Complete pair#* 

■P 

*99 

*aa 

*99 

Partial pairs* 

* 

* 

■M 

*99 

Triads* 

* 

m 

mr 

*99 


immM jmMs&k 

the tine taken by students In oonpl&tlog a given 
fora varied from student to student. The time for eaoh 
student wa* durly recorded* The time data are reported in 
the appendix A*94* 



per the four methods of seeling* the four form* 
were In the first Instants# administered to 4 independent 
groups of 14 eaoh* 

Mean and standard deviation* of time* taken by the 
students are given in *dM» W below* 






•88* 


TABUS 1 Q» 


Tin* taken by students In first administration, 
of forms {in minutes) for 4 grows 

of IS eaoht 

unii^niwfcffpi» o mm iiwuwiiwv if *‘T i— 

4 Methods Complete Partial Irlada quadruplets 

S * pairs* pairs* 

t> 4 

ft « 
t * 

i • 
e « 

« * 

1 i 

c 

<siwooawe#*<sa»a#oMa*>saaiMS^o»StWs**wwBHt«eNS*ssa»ssrw»^asiWSNs>^ea«ss^w)SaShsas tW s ai4M M>i^s<w a>eS^*** e »^ — * ***# 


naan. 13.87 11*88 18.13 11*80 

Standard 8*708 1*488 1.140 9*640 

deviation* 




4 4i 4i * — M Mbmws s *ansaw*wa#*w a e«i*f **■ 




fhis was like a Staple random lead do sign* For 
tasting atgniftosnas of diffsrsnes befewssn moons, the 
analysis of varlanes fop ena way alaasifloatlon has baon 
oarried out* Xhe table of analysis of varianes is given 

below* 


Analysis of VSpisnes* 
(Staple randomised dosign) 


Bourns of 
Variation* 

—1 « i | li MM 8* n 8 H 8 W 


df s*®* 

,i tMi m**m*Mhm 




SllMS* 


Treatments* * 88*88 

arrov m 8*8-88 


* Bimi ftattti uM lM level* 



17-787 

4-888 


f H»787 

SISST 

8*7880 
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By uijog Newman-Xeule pnoadun (table given In 
Append lx A«38) for tooting vrtilah means differ slgdlfloently 
from which other means, it is aeon that the means of tins 
corresponding to triads, quadruplets end partial pairs do 
not differ significantly from one another at B£ level of 
elgnlfloonoe, so far as evidence from data from four indepen¬ 
dent groups of Id Is concerned. There of oourea differed 
elgnlfloantly from the average time taken In complete pairs* 


aixrr judobb. 


Times, taken by the 80 students by eaeh of four 
methods ore given la the appendix (A-34)• Averages are 
summarised In table-la* 


TABUS 13* 

j. /y?£* 

* . r ' i_ i v ■■*■■ ■ 

v-W> ^ 4 t> ***■ ^ 4**>*±. 


ft* 


sdwefmM^ 




#*v« HdtM 
£ta«« 

Els* * 

tio# ****** 


Complato Partial Triads Quadruplets, 
pairs. pairs. 


mmum*** p i ft" *' 


w kn e 




w 


Ha an. Bsfift B*iW 7*88 


W. S.W liVUM* PB H B^S 


m iw i n oi' i i m* h * 


m 


Sept stmt the letia h«m« Uy-««8 *•» employed 


-fi S\ ' A I 
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counter tthiuw tta* order ifftott the appropriate m> 
l^els or variant* wee carried out following the procedure 
described in Winer's Statistical principles In experimental 
deal gnu and table showing procedure la given in the 
Appendix A«36* I ha analysis of variance 1» given la table 
13 below* fhe design aould be considered ee a cross over 
design* 


analto is or variance tabib. 
(croSB ever design) 


Souro# 0f 
variation* 

df 

S|S» 

M*&* 

r* 


Bubjests* 

09 

366.71 

6*80 

8*11 


Tvaatmanta* 

3 

391*64 

97 as 

88*94 


Treatments* 






Caaessiont* 

3 

1919*74 

699*91 

81*90 


Error* 

174 

613*67 

a *66 



fetal t- 

339 

309Q*B6 





It la eeon that the dlffevenoea In average tie®a taken 
by the four netted* are highly significant* Also there Is 
highly significant difference la the average tinea of tte 
four occessions of administrations the four orders 
of presentation* In this esse sines from tte error tern 
the iatsr*l»dlviduel vertstfsns have been removed, tte sfster 

to *ueh lever than that In tte analysis 


used fgnara 





PA 



*0B« 


of variance of talb* u. there the error m.e. Included Inter 
individual variation* we* 4<603* the testa of signifloano* 
in fcha analysis of variation fcelbe 13 an thus more powerful 
then those of tat la 11* 

The Newman-Kaml* es procedure p tab la i» given In A* 

36) applied for fcfco comparison of the means of table 13 , 

1^9 add to the conclusion that all the ram* differ slgftlfl* 
aantly from one another * In table li t the teat me not power* 
ful enough to bring out the slgnlflcanae of differences among 
the mean times of the triads, quadruplets end partial pair* 
procedure** 

C QttfrXGIfiOT O f A 6 KEBM 5 OT, 

* ** ***** mMifri i m 

The Coefficient of agreement between Judges in each 

of the four forma l*o« complete pairs, partial pair*# tried* 

* 

end quadruplets ore .£37» *331, *£39 and «&8B* These figure* 
ere not high, because in respeat of leisure time aatftvitlee, 
the p referenda a of the students are not littely to be the 
eense* But the coefficient of agreement le ranging from #338 

1 

to '037 for the four method*, indicating that all the 
student* agree to the name extent with ell the four method*. 
Thus so far it the extent of agreement among students i* 
aonearned, all the four mat had* afe more or less equally 
effective given consistent result** 


HgSs 




■hill l lUirtS'i. *iW»' 






* fortnule for oalsmlotlen eeeffisient Of agreement is taken 
t»m *f«ohnft*u«e of Attitude seal* construction* try 

SdMHPlJK A#,b# 1 ,' ,r." , 

, . .v ^ ‘S' J 1 
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XABLE 14* 

■D i i»i i (u l Ci*i ii W 

samms&~s&. jmsmu 

Gompiafca *387 

Partial pair** ■881 

IvlndBa *834 

Quadruplet®. •339 

i r h i if 1 - —» 1 ■ t ■ ■ i ■ ■ ■■ »» 





Msm 


^UtClfflSJOKSi op MSU1T3 AND 
^"qNCIiOSIOH$. 

WWlfce WM 


In this study the following four methode of scaling 
a liven set af 13 stimuli haw been eonpared empirically* 

1 * Complete palm involving 73 pairs* 

3s Partial pairs Involving SO pairs* 

3* Triads Involving a balanced set of 00 triad**and 
4* Quadruplet> Involving a balanced set of 19 
Quadruplet•» 

The IS stimuli ohosen were is leisure tine eativlties 
and the judges (the students of XI eless In a eel lege) were 
asked to lndloate their order of prefersnaes for these IS 
aetlvltiee bp a ash of the four methods* So with eaoh method 
the soaleveluee wore determined for each of the is nativities 
and there wow ooupavod to find out to what extent the four 
wthoae loud to the same so a to values* Alto the average tint 
taken with each method was tabulated to find out whioh 
method took least tin* and the average tines differed 




signifies&ntly fo* th» four toothp&n* 

In quo typo of wtslytilni only tha data for tha four 
methods ai triad on four Indop&ndant randomly formed group a 
of U oaQh wwi oomtldared* tn this oasa btooauBa of small 
algo of oaoh group and booausa of largo Individual varla* 
tlona in the matter of yroforonoas of the leisure time 
Activities^ vary high correlations are not expected between 
the eaalovalues obtained by the different method** It la 
found that the rank correlations between the oat hods varies 
from *58 to *06 and produet moment oorrelations between 
scale values varies from *dQ to *84* fime taken by judges 

in rating task is 80< in quadruplet and partial pairs and 

* 

Btfl in triads of the average tins taken fa oumplsta pairs* 

In another typo of analysis, tbs aoala values of 
the nativities wara obtained by seah of the four not hods 
triad on the same Mt of do students of the sample* Of 
oourss the design was snoh that no ona method was unduly 
favoured# fho order effects mere properly oounter balanced# 
Here If the four methods are equally effeetlve* It 1 b 
expected that tMy would lead to almost ldentloal *eal* 
values, because they are used on the seme eet of do aubjests 
There msy be seoe effect of msaery influencing the re up one Is 
to the forme that were given to the students on the and, art 
and 4th secessions• The triads and gua&mplote are Miy 
different in nature and bo the biae due to memory probably 
would not to serious* Mere over eueh effects St any would 
equally tte four methods,, so oydsy effootje 




ar ® Mwtw bilntii or tquilly distributed over ell the 
four an Chads* 

Here produet mooest correlations between soale*»vaiue* 
era ranging from ,97 to , 90 , The rank correlations ere bet* 
emeu *93 to *90. the tine taken by judges In rating task 1* 
®W itt partial pairs, 77* in triads end 06< In quadruplets 
Of the average time consumed in complete pairs* 90 complete 
pairs take maximum time* 

Though the average time differ significantly for 
the four methods, It Is expected that the differences mould 
become sharper had a similar comparison been made for mere 
than 13 stimuli, bom* time is spent In following the for 
eaoh ease* This would become a email t fraction of total 
time in ease these are a large number of stimuli* It la not 
possible to generalise the results about ''average time*. It 
mould depend on the nature and m number of stimuli, length 
of Instructions etc, but it seems that In a fit situation 
similar to the present the least tins would be required 
in partial pairs, some more in trials and quadruplets and 
wnax l mtua tins consumed in eomplte pairs of course* In a 
similar situations, the short out procedures can be used 

l 

in stead of the eemplate pair* comparison without making 
serious difference to the scale-values and the ranks of 
stimuli* Those short out procedure* will result in saving 
of ti me . Those procedures will be mere useful in the 
situations, where the number of stimuli is large* 
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Coat? latent e of unmnt bttwun Judge e in then* 
foiw methods an ranging from »a&B to *aa7* These are not 
blsh| but In nu of let aura tins activities muah agree- 
nant Is not expsated* It shows a trend whatever degree 
of agreement there exists. It la the same mIU for all 
the methods of sealing * 

Inter rater reliability figures In these four 
methods ora ranging from *96 to *80* It shoes that judges 
are squally consistent In eseh of four methods* It 
apparently means that crenel otenoy la not dirsat function 
of time| which raters consume* 

miaasm jossa* 

this study is baaed on a sample of do Individuals 
only* For the comparison between the four methods baaed on 
data from 4 independent groups, the alas of esoh group la 
just 16* The stimuli in this study are auoh that agreement 
among judges la not amah* Xhs re suits oen ba generalised 
to only such stimuli* The others bare earlier worked Kith 
other types ef stimuli* Bare also the four methods ooula be 
compared using ether types of stimuli* Thera are only 19 
stimuli* It would ba of Interest to see what would happen 
with more stimuli* 
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Hjy ffig amiBt lof gonplete pair* for 
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™*«waj matrix 

u__ M ?ona ) 

" i^Wats ot 60 juicai 

^ { - 1 ® a ® ^ *» W ll 1 < jl~gJ go'|g Jg 

a « «ua a* Man u «■*»« 

*84 9 * #1# **8410X»a w 

83 44 64 39 31 60 88 99 M 46 31 86 

6 46 38 81 31 8» 81 84 a» 40 *118 81 

* 41 37 80 88 31 14 18 19 41 48 16 60 

7 44 38 86 80 39 48 37 86 47 48 81 8 * 

8 44 29 40 aa 34 34 aa 04 35 40 fl3i 4Y 

9 49 41 06 31 87 41 90 30 46 41 30 ^6 

10 30 24 60 10 BO 19 19 86 17 87 10 01 

11 96 96 49 IB 19 1$ 14 20 19 09 IB 40 


18 61 48 67 SB 4? 48 99 99 4Q 30 48 


60 


19 98 B 86 6 9 IQ 6 19 6 914 8 
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A»l8 

^RBQUBHCy M&TRfv 
(XRXAD FORK) 

fl«Md on the judgewnts 0 f aixty judge a 

,-LJLJ,4 a 8 7 a a iflii in la 
1 } 18 40 0 la 17 11 16 $ U 17 alfl 

3 |42 63 12 30 99 13 30 19 30 31 11 60 

3 j30 7 6 6 B 6 ae 3 33 14 6 31 

4 1 61 48 66 44 37 32 36 33 49 Qo 27 66 

6 j47 30 64 16 28 21 33 26 36 44 IB 61 

8 |43 31 62 23 3a 16 27 23 38 42 17 02 

7 |49 42 64 28 39 46 34 26 46 4? 24 63 

8 144 30 34 84 27 33 26 26 38 36 23 60 

8 J04 41 67 27 34 37 36 36 44 43 19 48 

10)46 30 27 11 26 24 16 22 16 38 16 68 

Uj43 29 46 IQ 16 18 13 26 17 28 8 47 

19)60 49 66 33 42 43 36 37 41 48 GS 66 
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PUBQUBHqg HAIRTy 
QUADRUPLBJs form 

on the judgement0 of eluty judges 


2 148 

_ I . 


^ 7 B,9 10 111ft 13 

18 39 ? 9 10 ll 1$ 8 19 39 7 41 
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5 181 32 84 38 30 24 33 30 36 3? 30 49 
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-FRBqUBWCy MATRIX 

( Comp left Pair p orffl > 

flae*d on firat ranaoni half 9t unlvereq of 

ftfty~8lx Judges* 

Group a* 


1 

a Jaa aa a u 171117 01710 0 2 s 

3 |13 0 309 g 7s09g go 

4 Jfay 20 20 19 18 10 20 12 23 23 11 20 

0 J20 14 23 9 18 9 13 10 17 21 8 24 

0 |19 11 22 10 IQ 6 10 6 17 la 10 a0 

1 

7 |S8 17 26 12 19 23 21 10 23 20 11 26 

a 120 11 22 8 10 13 7 12 14 16 7 24 

I 

9 J25 23 26 16 IB 22 18 10 22 21 11 27 

10120 11 22 0 11 11 0 14 0 18 4 20 

U|17 13 19 0 7 10 8 12 7 10 0 21 
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JIRBQIMSHCr HaTMy 

(Complete Pair Perm) 

iJaaed on fir«t random half of universe of 

fifty*#!* juag««. 
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U 
a jio 
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3 ilO 4 

4 127 20 28 

8 l22 16 86 la 


0 18 16 8797 Up 

24 8 13 13 7 12 12 18 16 
38436348 
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4 10 
6 23 
1 14 
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7 23 
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6 11 12 21 20 6 
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a jig 16 as la 10 17 13 
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10117 12 24 6 3 7 6 10 9 

j 

11119 12 20 « 11 8 0 7 7 12 7 21 


16 18 2B 22 8 24 
12 18 21 18 20 
10 21 9 26 
16 0 23 


12124 23 27 19 21 22 20 10 19 22 31 27 

131 9614260483071 

X mi r r¥ t - - &++m ■ Jt - ■ ■■ ■ ■ — * - -- ^ 
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EBSQUBR^t 

( Partial Pair Form ) 

Based on second random half of universe of 
«fty»alx Judges* 

Group B* 

LJLJI * 8 6 ? B B 16 ii ia is 


1* 

I 

a* laa 

| 

4 


8 



7 

9 



10 

19 


94 


14 



14 

e 



6 

a. \ 

i 

4* use 

4 


4 


4 



4 

a 


10 


ae 


16 


17 



18 24 


fi. { 

* J 

‘ j 

14 


10 


16 


18 



80 11 


84 


12 


4 


9 



7 83 

7* Sal 

IT 



11 


84 


16 


as 


99 

0. J19 14 

W 



18 


10 


10 


18 


B. I 

SO 24 



19 


18 


ia 


7 

10.{ 


83 10 



6 


10 


10 

93 

11*116 

V 



4 

6 



10 


ia 


a 

ia*{ 

13*1 B 

B0 



17 81 



21 


80 

88 

13 



6 
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JL 
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FHBQUEKCI MAlflly 
( Partial Form j 
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1 

w 

1 

r 

9 


4 



4 

9 

19 

10 

a : 

[ ao 


ai 


1a 



14 

9 

10 

3 


7 


0 


7 



3 8 

17 

4 : 

f 04 

I 


03 


19 

12 


18 84 


* 

16 


9 


11 


18 

81 

8 

e 

! 


ai 


17 


0 


19 

7 as 

7! 

1 

1 M 



10 


ao 


19 

90 

90 

a | 19 14 



10 


9 


10 18 


9 

1 

r 

l 

19 80 



18 


ia 

17 

10 

10 

V 


ao 10 



8 


11 17 

aa 

11 

Ifl 



4 

7 



IQ 

11 

7 

is 

1 

1 

18 



ao ai 



19 81 

90 


W i la n 9 9 
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Clpiftd Fora) 

of 

Batod on flrifc random half/uni vs rao of 

flftyofllx Judgoe, 

flroup a 

i a 3 * a 6 7 a 0 iq u as as 


>*■ 1 m t mHWMfcwrai -. 

6 20 670504 60S 1? 


1 I 

I 

3 (22 S3 4 11 la 9 17 0 IS 16 4 04 

3 { 8 6 3364 10 3 11 68 16 

4 123 24 35 7 19 10 17 17 Si 22 11 26 

6 (21 17 36 21 12 10 18 13 18 SO 10 86 

6 (10 16 32 0 16 6 12 11 13 20 7 24 


7 123 10 24 13 IB 22 


I 


17 10 11 82 9 26 
0 14 14 B 23 


8 (19 11 16 11 30 16 11 

( 

9 (24 19 20 11 16 17 IB 19 

10 {as 16 17 ?W 13 17 14 10 20 7 04 


18 19 8 22 


( 

11 (19 12 22 6 B S 0 14 9 
(26 24 20 17 IB 21 10 20 30 


8 


3 Si 



31 85 96 

4 7 2 



nM— 

A-19 

tfrooaeHoy MATRIX. 

( Triad Fora ) 

Bflflod on iBaofld random half of univorso of 

fifty-al* judgae* 

Group B» 

12 3 4 8 8 7 B 8 10 11 12 IB 

---— M -»- ■ j -7* .g sg 

1 j B 18 378361 991 17 
| 

2 j BO 20 6 18 17 8 10 8 17 13 0 23 

3 jlO 8 B 8 1 Q13 0 1? 6 3 18 

4 {SO 83 86 82 16 18 16 12 26 82 16 84 

ft jal 10 28 8 18 8 18 9 16 30 8 Si 

6 |82 11 87 12 18 7 11 9 19 20 8 86 

7 Jaa 80 28 15 20 21 14 13 28 80 M 26 

8 jaa 18 18 13 16 17 14 16 20 18 14 86 

8 ja? 20 18 16 19 18 16 13 28 88 83 23 

10 jl9 11 11 3 13 9 6 8 6 11 6 24 

11 |l9 16 83 6 8 6 8 10 6 17 a 88 

18 j37 82 86 18 aa 80 M 14 6 83 86 86 

13 ill 8 13 * 1 3 I j * * O— 




-lo5- 

A«ao 


frequbncs matrix 

(quadruplet Form) 

Baaed on first random half of universe of 

flfty«alx Judges* 


Group k 



II 7 18 46778410 11488 
2 I 81 80 10 16 16 8 17 814 16 10 86 

a{ 10 8 344486481 19 

I 

4 I 84 18 26 17 17 18 21 18 82 84 12 84 

I 

6 I 22 13 84 11 18 12 19 W 17 18 8 86 

8 | 21 13 24 11 10 7 12 6 1? 17 6 24 

I 

7 ! 81 20 84 16 16 21 17 U 16 14 7 88 

8 I 20 11 20 7 9 16 11 8 12 16 10 22 

] 

9 I 84 22 86 10 12 22 17 20 16 18 7 88 

i 

10 I 18 14 84 6 11 11 18 16 12 18 7 82 

11 I 17 13 20 4 10 11 14 13 l8 13 3 24 

| 

12 I 24 18 87 16 80 23 81 IB 21 8l 26 87 






-I°1- 

A«aa 



(Complete Pair Porn) 


BaMd an judgoramte pt fifteen judges 


1 

I~* 

I 

l» 

i a 

{ U 


3 9464 069784 lo 

14 9 is ii b xx io ia u 6 ia 

1 0491088416 

0 18 9 11 9 10 6 10 10 6 la 


01 90 11 6 7060783 10 

6 j 11 4 13 4 a 4 6 0 8 10 6 10 


7 j 10 7 14 6 10 11 10 7 9 11 4 11 

I 

8 j 10 4 18 6 9 8 6 6 10 9 4 10 

9 J 10 0 13 8 10 10 8 9 9 12 4 13 


10 J 83 18 687037 10 8 12 


| 

11 [ 7490704930 39 

12 { 11 10 14 10 12 13 11 11 11 12 12 14 




“loft - 

Fflagtigwqy hatrix 
(Partial pair fora) 

Baood on judgogwnbg or judges* 








H 

IS 

P 

H 

g 

XI 

p 

to 

© 

ID 

P 

O 

s 

to 

H 

to 

H 

P 

P 
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to 

& 

p 

to 

£ 


to 

to 

to 

to 


p 

-a 

P 

P 

« 


& 

o 

o 

3-* 

P 


•4 

to 

n 



to 

to 

to 

p 


to 

to 

to 

s 

to 

to 

to 


to 

0 

6 

£ 

0 

e 

« 

to 

£ 

to 

P 

O 

p 

p 

£ 
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£ 

to 

to 

to 

» 

to 

» 

o 

to 

£ 

£ 

i 

£ 

p 

o 


s 


to 

w 

o 





to » 




& to to 


ft 
to 

0 Q 
to to 
«k to 


P 

P 


O 

P 



G«l 



-Nd- 



(Quadruplet Fora) 

BtNd on the Judgement of fifteen Jalgae 
18 3 4 SO 7 6 9 10 11 la la 

i ] m o i n t o u o t 

I 

8 } 9 H H H 3 5 UU 

| 

a J 6 6 934138888 13 

j 

4 Jl6 13 13 0 a 1 10 11 13 10 8 13 

0 |u 11 la 10 a 6 7 1110 9 9 14 

6 |l4 10 11 7 7 6 fl 4 13 8 7 14 

7 |14 13 14 14 10 10 8 9 11 a 3 18 

a 13 10 13 5 B 9 7 0 10 3 8 14 

9 |10 la 13 4 4 11 8 10 8 7 4 18 

10 }l2 10 13 8 8 3 4 8 7 4 4 14 

11 jl8 11 13 8 8 7 7 10 8 11 8 18 

18 Sl0 13 13 8 3 8 10 7 11 11 10 34 

13 I 8 2 8 8 1 1 0 10 1 0. A_ 

m/m M - -- - — --- ~ -- 




A -26 

IM«oh mu 


(Couplet* Pairing Fora) 

Bitod on tiu Judgawente of aluty Judgit* 


1 





JL 

Ju 

JL 

JL 

. 8 - 

JL 

u , 

, iq 

k * J 3 

■ 

* a 8 ? 

1000 

.117 

i 860 

*317 

*807 

*807 

.103 

480 

417 

•200 

,833 

St 

.733 

» 

.880 

.887 

.487 

*080 

.307 

.017 

.317 

.800 

.668 . 

.800 

.807 

9 . 

40 Q 

•180 


.100 

.180 

* M 7 

.083 

.800 

,087 

,167 

.883 

.060 

•883 

4 i 

m 

.733 

.600 


.880 

.033 

.000 

.033 

483 

*833 

.600 i 

.380 

.919 

it 

.780 

.733 

.680 

.380 


i 486 

.380 

433 

.383 

*607 

.883 

.317 

*800 

i « 

.683 

*480 

.833 

*387 

.817 


.833 

433 

.817 

.083 

.700 

.300 

•930 

7 . 

.733 

.833 

.917 

.800 

.080 

.787 


417 

417 

*783 

.707 

,800 

•900 

8 . 

*733 

•483 

.800 

. 30 ? 

•887 

.887 

.383 


433 

,883 

•607 

*380 

•783 

9 . 

*817 

.883 

.633 

*017 

.817 

.063 

.083 



*717 

.683 

,333 

*917 

10 

.880 

400 

,833 

.107 

.333 

*817 

.817 

417 

,363 


.017 

.167 

.880 

11 

1 

.083 

.417 

.717 

.300 

.317 

.300 

.833 

.393 

.317 

.383 


.300 

.787 

16 

*880 

.600 

.980 

.080 

.783 

*700 

.000 

.080 

.667 

.633 

.800 


*987 

ia 

v »367 

.133 

.417 

i. . ■ 

483 

,180 

♦147 

.100 

.817 

*083 

♦160 *233 

*,031 

rr1 1 












(Partial Psl? Pen) 


BaNd on JudjBWQti Qjf ilitty Judg«, 


6 « 10 11 la 18 





m 


m * 31 ? 


•400 *633 



Hot* »* Pjj- 




a i 

3 1 
4 
ft 

« I 

* I 

7 

a 

a i 
10 
u 
is i 


13 


I 


A*28 



(t ttnft Form) 

$ftM& on JWgOMnfcB of sixty judgio. 


l 



♦300 i897 

•ISO 

*817 

1 m 

1 483 *887 

1 400 

*360 

•888 

*089 

•883 

•883 

*800 

i8Q0 

•IBS 

<300 .300 

.317 

*800 

•817 

483 

•893 

l 

m 

•100 

*133 

400 m 

•080 

.860 

.333 

.083 

•817 



*733 

.817 

*393 id00 

•680 

.817 

•833 

•480 

•917 




•487 

*•860.680 

•433 

•888 

•733 

*300 

*880 





i880 *480 

.389 

•000 

.700 

•889 

.68? 





tW7 

•417 

*780 

.783 

•400 

.867 






•417 

*083 

•888 

•889 

*898 







•789 

.717 

*917 

.800 


m i838 
*138 


887 

788 





Hot* i 






1 


i 

I 


1 

a 

3 j 

4 i 

6 1 

i 

8 
7 I 


I 


8 

J 

3 \ 

10 ) 
I 

11 l 

I 

12 1 

I 

m 


-UM- 

A <*29 



(Quadruplet farm) 

Ha«®4 on Judgeraant* of sixty judges, 
8 3 4 8 


a 111 

7 

S 

1^, 

JO 11 

18 

13 

.187 

.183 

.897 

*100 

» ai ? 

.387 

.117 

483 

.483 

.317 

.81? 

.317 

.660 

.800 

.883 

.887 

.187 

.083 

.800 

.08? 

.133 

*233 

.087 

.883 

.087 

*433 

.880 

.633 

.783 

.817 

433 

.887 

.683 

400 

.060 

.800 

400 

417 

.883 

.817 


.883 

.460 

.863 

.683 

417 

.287 

417 



.660 

488 

.833 

417 

417 

.880 




417 

.887 

.883 

417 

.883 





.88? 

.800 

.288 

.017 






.467 

480 

.800 







.183 

.817 








.000 


*******1 


4« 4 i* w s t p H * 




dote j* Pjj-1 *Pjj 




-IIS- 

A*30 

S-Matrix 

+ * * m+4**im 

( Comp lata Pair fora ) 
BaMd on Judgments of sixty Judges* 






I 

Contd*• *• .A *30) - jit, - 



**■693 

-*904 

*•386 

-•810 

*1.036 *840 

*043 

-*470 

•868 

•820 

*•668 

1.118 

*•848 

i49d 

*■966 

-•674 

•11046 

•810 

•340 

"•040 

•966 

*848 

*«386 

1*386 

-*169 

-•aee 

•438 

•476 

-•Tea 

1*036 


"* 47 # 

•478 

•684 

-■684 

•960 

■SOS 

•#3W 

•788 

■789 

"•366 

1*382 


-.100 

•aio 

*468 

•■390 

•768 



•674 

.476 

*•460 

1*386 




*898 

*•966 

1*086 





*•848 

•789 






1*686 






1 


. ' 117 - 

k*l 


1 * 

2 . 

3 # 

4. 

5 * 

6 * 

?♦ 

8 * 

9 , 

104 

n ♦ 
12 . 
19 » 



(Partial palp Fora ) 




Hotai» 




11 ' -m- 


II L J ^ XB ll 

* 4 * w **sas ,34Q 

*•048 «*BH *,47$ 

'"1*180 **i68 fc lg4 

#3«« i»oaa 

*0« *674 -,340 

*•388 **6aa ,84a 

•3W *788 1,036 

*>w *m 

*366 -*476 

•186 *768 


-■904 


1*838 



-Jl*- 

A«aa 


Z«H a trii 
( triad Form) 

Bated on jadgaotfnta o t sixty Judgat, 






In f 

..I 
a . I 

I 


•iffii 430 *1*033 *.7S8 •*073 *,904 

1«1®0 **M3 *0000 •«0*S •*0S4 

*1*395 *1«3BS *1*112 * 1,282 



*323 *298 ,083 

•*083 **380 

-.374 


I 




Beta i** 2|j- »z^ 



**688 

* 1*868 

*474 


* 1*980 *210 

•000 

*#476 

•boo 

•048 

*•004 

#966 

*•169 

• 1*646 * 1 b 6 

•*788 

• 1.885 *048 

*989 

•169 

*904 

•966 

*•186 

1 *880 

•186 

4469 

•810 

•688 

*•684 

1.086 

-• la * 

*•908 

#888 

.894 

*•574 

1418 

•169 

*•910 

•m 

•788 

*•988 

1418 


*#810 

•840 

•810 

*•808 

*966 



•688 

•874 

*•478 

•848 




•088 

*•780 

1418 





•iaia 

•788 


1.499 


A«39 


Z * MATRIX 

tm m a m <4 

( QUAdmplet Pom) 

Based on Jadgenwits of sixty Judges, 


8 3 

4 .« 

6 

7 

*<634 *686 

*1<190 *1.036 

••*968 

**904 

.788 

*.004 *»0B3 

*#043 

*#4?0 


*1*499 *1.888 

**960 

*1.386 


.810 

#169 

*.189 



•810 

*.863 




*.674 



flontd 


*A*33) 


\2X- 




*•822 *1«2B2 **478 *#340 



*1*100 *478 


•043 **478 *128 iO00 *.674 1*118 


*•842 *1*499 *1*112 **729 *1*499 *2lO 


•386 

•340 

•128 

•000 

*<188 

•*871 

•188 

••043 


*.aio 


•799 *904 

•983 »B98 

*810 *298 

*340 *998 

•189 *810 

•189 *883 

*•089 


*•189 1.119 
**439 «0O4 
*•829 «904 
*•878 1.088 
••910 *968 
**874 1*338 
•*874 *848 


••904 *904 
1.883 






*-34 

HMDS DATA 


(In MJnutnfl) * 

Group X«t. 


B »So. Ufc Ordof Had o*d«r 
(Covplat*) (Irlad) 

Illrd Ordsr ivth Order 

(QuftdrupXot) (Pirtinl) 


1. 

14 

7 

7 

8 

a* 

14 

8 

7 

3 

9r 

18 

3 

7 

a 

4. 

17 

8 

7 

a 

9. 

10 

B 

7 

a 

tit 

13 

9 

7 

4 

7* 

18 

7 

9 

a 

8* 

34 

7 

8 

8 

9* 

13 

3 

4 

3 

10* 

19 

8 

7 

4 

11. 

17 

8 

7 

8 

IB* 

14 

4 

4 

8 

13. 

14 

8 

4 

8 

14. 

14 

9 

7 

4 

19* 

07 

9 

9 

8 



Contd* * 

-\1V 

*•**••*»»* 84*A) 

Group B 

let Order XltA Order 

(PerMel) (quadruplet) 

HIM Order 
(c«opiate) 

ivth 

order 

(Trie 

1ft* 

0 


9 

7 

7 

17* 

10 


ft 

a 

4 

ia* 

10 


6 

ft 

4 

10* 

10 


6 

4 

4 

80* 

11 


7 

7 

7 

81* 

11 


10 

« 

7 

98* 

11 


7 

7 

0 

93* 

18 


11 

a 

4 

94* 

1ft 

JMw 


11 

e 

a 

90* 

13 


7 

7 

4 

94* 

19 


ft 

a 

7 

07* 

14 


10 

4 

7 

86* 

14 


IQ 

7 

7 

80* 

11 


7 

6 

6 

n 

90* 

1ft 


11 

9 

7 




I LP> 


Qfroi^p C-i 


S «NO 4 

lat Order 
(mad) 

Ilnd order 

(Complete) 

Jllrd Order 
(Partial) 

IVth, Order 
(Quadruplet) 

di« 

14 

7 

7 

4 

as* 

14 

6 

0 

A 

33* 

13 

7 

7 

0 

34. 

aa 

3 

0 

3 

3fi» 

13 

4 

3 

3 

33* 

13 

7 

0 

3 

37* 

18 

0 

4 

3 

38* 

is 

4 

7 

0 

39* 

IB 

0 

0 

3 

40* 

18 

0 

0 

3 

41* 

11 

4 

0 

4 

43* 

11 

0 

3 

• 

43* 

U 

0 

3 

3 

44* 

U 

4 

4 

4 

40* 

10 

4 

4 

4 




-ilfe- 

..it a*34) 

Group D« 


&.Ko» 

Iat Order 
(Quedrup* 
let) 

XI nd Order 
(Partial) 

lllrd Order 
(Xrlad) 

XVth order 
(Complete) 

40. 

14 

9 

0 

11 

47* 

14 

4 

0 

11 

48, 

11 

3 

4 

0 

49. 

10 

3 

3 

10 

60* 

6 

3 

3 

30 

01 

0 

a 

3 

0 

fie 

10 

3 

4 

0 

53, 

11 

a 

4 

7 

64 

ia 

a 

0 

10 

50, 

12 

3 

4 

7 

00. 

13 

a 

0 

11 

07* 

13 

a 

a 

9 

68* 

14 

3 

0 

a 

09* 

14 

3 

5 

10 

00* 

34 

a 

6 

10 





-V 2 . 7 - 

A*sa 


To toot that tfto population idoodb of £ group* art 
oqual) oi» nop uaa go an altornat&vo to tho utual 
the etafclBtlo q dofSnafc ao 

(k, no) l^aax 

J mm wuar* *t »wSr 
a 

t wax * I Main. 

m && s^frsrns sr 


vtmr* t mux end H min are raepsotive ly the largoat 
fnd the smallest means out of f means, t ms* and t min sr* 
the largest end smallest group total* 

ns df for the error m.s* It l» *»Burned that all 
groups tow n observations eaoh under the null-hypofch*ala 
and undsr the assumption that the distribution of the 
measurements Is approximate^ normal, the ssepling diatrl* 
button of tto Statlstlo <j t» that Of tto studontisod range 


having parameters k • number of trsatmenta and t degree* 

of frcMdou for M or*©*# 

Uto 89th and 88t» peroaatll# of *>» q-ststlstto 


•ro given in table B*d of Winer's book, stati-tloal prlnalpW. 
of experimental dooigme* 

She q* statlstlo la partlouUrly useful for feertin* 

which Men* differ free * hloh 9tlh * p0 » * ft * r tow * ,a# **** 
F.ratio 1» a»»ly**e ef varloto* 1* ilgnifi«»*» 

this fmMM* it »aiw» *» K*ul» **»j*fr 

w a»ta have been tsbon free (Appttdl^i 1 
elnt to to**# eo«*fi»My. ®»ta nav* *•* 


j: 'j 

y, faT' 

■ k/V'Ji 


( 


-S 1 ' 




- m- 


A-34 for first administration ana teblo 11 of Chapter V, and 
table Is prepared aa bo low* 

Table i Differences fattnun total of 4 Independent . 

Groups of le each* 


'■ »" * . * If Biiar. m>* ..raw iso«a, T „a . < . M .. ll . 1 —■ J tT IT ~ rMrT I BW# V Iff ,1 ■ ■ ~1 *» if 

Methods* Complete pair** Triads.Quadmp. Partial 





lata* 

pairAa 

Total sen of 
groups* 

IIL , %r W - — 

908 

183 

174 

ITS 

Complete 

pairs* 

m 

30* 

* 

34 

S6* 

Triad A# 

« 

* 

B 

9 

Quadruplet** 



m 

X 

Sara ne 80 

and Ha 

error 0.003 


9.90(k.66) 

4 

a 

a 


Q 'values at 

30* 

3.74 

3 add 

0*83 



31 .SB 

80*80 

03*70 


Hare t aa* 

■ i sin 

00. This 

la greater then 


q.88 (4*66) 31*48 and ao at 8* level, the naan of partial 
pairs differs el^tifieant bf from that of wap late pairs* 
Similarly th« difference la totals for p and eonpiefce pairs 
la 34 1 whioh la elgaifloent *hen compered eith q»06 (9*64) 

38*88* Alee the dtff«T«iwa in the totals of 
triad and aonpleto pairs la *08(0 »0i) B8«M 

Bvtt ao other differ naae ara etgnlfleant* Jfrnee the means ftf 
triad auadruplet and partial pair* ear be warded aa 
differing elgdifleantly free the mean ef complete pair** 881 
sot differing Blgaifleantly free eaah other* 







TO test the significance of difference between 

means of table 12 , wo use Cowman Seul‘e procedure as exp la lead 

In Appendix a< 36. According to tula procedure raceseary data 

aummarlied below front tables la of chapter V end Appendix A-34« 

Sable i * Differences between total of tinea 

taken in four methods (based on data 
from «o subjects) 


Method* 

Complete 

Quadruplet 

Triads 

Partial 

Pairs* 

Total sun of tine 

819 

478* 

448* 

339* • 

for group do in 

each fora* 

Complete 


48* 

77* 

• 

160 

Quadruplets 

* 

48 

* 

81 

• 

194 

o 

Triads* 

m 

(• 

m 

103 

Truncated range 

4 

a 

ft 


>96(r,l?4) 

(4,174) 

0,174) 

C (2* 

174) 

According to 

3,83 

3*31 

8*77 

wine*** Wbia* 
B*4« 

18*88 

ia*M 

11,88 


•Horo ell differences are algnlfleant• He auaplete 
pairs, m wlnlnMi ttm end mi takes mxlsu» tins and partial 
pairs the minimum time, the triad takes i*e* tine, than 

quadruplets* 


